Loopy Propagation: the Convergence Error in Markov Networks
نویسنده
چکیده
Loopy propagation provides for approximate reasoning with Bayesian networks. In previous research, we distinguished between two different types of error in the probabilities yielded by the algorithm; the cycling error and the convergence error. Other researchers analysed an equivalent algorithm for pairwise Markov networks. For such networks with just a simple loop, a relationship between the exact and the approximate probabilities was established. In their research, there appeared to be no equivalent for the convergence error, however. In this paper, we indicate that the convergence error in a Bayesian network is converted to a cycling error in the equivalent Markov network. Furthermore, we show that the prior convergence error in Markov networks is characterised by the fact that the previously mentioned relationship between the exact and the approximate probabilities cannot be derived for the loop node in which this error occurs.
منابع مشابه
Correctness of Belief Propagation in Gaussian Graphical Models of Arbitrary Topology Correctness of Belief Propagation in Gaussian Graphical Models of Arbitrary Topology
Graphical models, such as Bayesian networks and Markov random elds represent statistical dependencies of variables by a graph. Local \belief propagation" rules of the sort proposed by Pearl [20] are guaranteed to converge to the correct posterior probabilities in singly connected graphs. Recently good performance has been obtained by using these same rules on graphs with loops, a method known a...
متن کاملGeneration of Random Bayesian Networks with Constraints on Induced Width, with Application to the Average Analysis of d-Connectivity, Quasi-random Sampling, and Loopy Propagation
We present algorithms for the generation of uniformly distributed Bayesian networks with constraints on induced width. The algorithms use ergodic Markov chains to generate samples, building upon previous algorithms by the authors. The introduction of constraints on induced width leads to more realistic results but requires new techniques. We discuss three applications of randomly generated netw...
متن کاملCorrectness of Belief Propagation in Gaussian Graphical Models of Arbitrary Topology
Graphical models, such as Bayesian networks and Markov random fields, represent statistical dependencies of variables by a graph. Local "belief propagation" rules of the sort proposed by Pearl (1988) are guaranteed to converge to the correct posterior probabilities in singly connected graphs. Recently, good performance has been obtained by using these same rules on graphs with loops, a method w...
متن کاملLoopy belief propagation for approximate inference : an empiricalstudyKevin
Recently, a number of researchers have demonstrated excellent performance by using \loopy belief propagation" | using Pearl's polytree algorithm in a Bayesian network with loops. The most dramatic instance is the near Shannon-limit performance of \Turbo Codes" | error-correcting codes whose decoding algorithm is equivalent to loopy belief propagation. In this paper we ask: is there something sp...
متن کاملOn the Convergence Error in Loopy Propagation
Reasoning with a Bayesian network amounts to computing probability distributions for the network’s variables. Pearl’s propagation algorithm provides for efficient reasoning with singly connected networks. When applied to a multiply connected network, the algorithm no longer yields exact probabilities, yet has been reported to result in good approximations. In this paper we provide some theoreti...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2006